Pandas Profiling Report

Dataset statistics

Number of variables	14
Number of observations	2774
Missing cells	0
Missing cells (%)	0.0%
Duplicate rows	0
Duplicate rows (%)	0.0%
Total size in memory	303.5 KiB
Average record size in memory	112.0 B

Variable types

Numeric	13
Unsupported	1

Alerts

`gross_revenue` is highly correlated with `invoice_no` and 6 other fields	High correlation
`invoice_no` is highly correlated with `gross_revenue` and 2 other fields	High correlation
`avg_quantity` is highly correlated with `gross_revenue` and 4 other fields	High correlation
`total_quantity` is highly correlated with `gross_revenue` and 6 other fields	High correlation
`avg_ticket` is highly correlated with `gross_revenue` and 4 other fields	High correlation
`avg_basket_size` is highly correlated with `gross_revenue` and 4 other fields	High correlation
`avg_un_basket_size` is highly correlated with `avg_quantity` and 2 other fields	High correlation
`stock_code` is highly correlated with `gross_revenue` and 2 other fields	High correlation
`qty_returns` is highly correlated with `gross_revenue` and 4 other fields	High correlation
`avg_quantity` is highly skewed (γ1 = 51.01197811)	Skewed
`avg_ticket` is highly skewed (γ1 = 51.90076423)	Skewed
`frequency` is highly skewed (γ1 = 46.08539806)	Skewed
`qty_returns` is highly skewed (γ1 = 50.10197766)	Skewed
`avg_basket_size` is highly skewed (γ1 = 44.86093386)	Skewed
`df_index` has unique values	Unique
`customer_id` has unique values	Unique
`avg_recency_days` is an unsupported type, check if it needs cleaning or further analysis	Unsupported
`recency_days` has 34 (1.2%) zeros	Zeros
`qty_returns` has 1481 (53.4%) zeros	Zeros

Reproduction

Analysis started	2022-10-13 20:05:52.218883
Analysis finished	2022-10-13 20:06:48.527017
Duration	56.31 seconds
Software version	pandas-profiling v3.3.0
Download configuration	config.json

df_index
Real number (ℝ_≥0)

UNIQUE

Distinct	2774
Distinct (%)	100.0%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	2251.237203

Minimum	0
Maximum	5696
Zeros	1
Zeros (%)	< 0.1%
Negative	0
Negative (%)	0.0%
Memory size	21.8 KiB

Quantile statistics

Minimum	0
5-th percentile	181.65
Q1	901.5
median	2061.5
Q3	3411.25
95-th percentile	4958.85
Maximum	5696
Range	5696
Interquartile range (IQR)	2509.75

Descriptive statistics

Standard deviation	1526.597887
Coefficient of variation (CV)	0.6781150763
Kurtosis	-0.956310095
Mean	2251.237203
Median Absolute Deviation (MAD)	1241
Skewness	0.3794934938
Sum	6244932
Variance	2330501.11
Monotonicity	Strictly increasing

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0	1	< 0.1%
2910	1	< 0.1%
2896	1	< 0.1%
2897	1	< 0.1%
2900	1	< 0.1%
2901	1	< 0.1%
2905	1	< 0.1%
2906	1	< 0.1%
2907	1	< 0.1%
2908	1	< 0.1%
Other values (2764)	2764	99.6%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
0	1	< 0.1%
1	1	< 0.1%
2	1	< 0.1%
3	1	< 0.1%
4	1	< 0.1%
5	1	< 0.1%
6	1	< 0.1%
7	1	< 0.1%
8	1	< 0.1%
9	1	< 0.1%

Value	Count	Frequency (%)
5696	1	< 0.1%
5686	1	< 0.1%
5680	1	< 0.1%
5655	1	< 0.1%
5649	1	< 0.1%
5638	1	< 0.1%
5637	1	< 0.1%
5621	1	< 0.1%
5620	1	< 0.1%
5611	1	< 0.1%

customer_id
Real number (ℝ_≥0)

UNIQUE

Distinct	2774
Distinct (%)	100.0%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	15285.69971

Minimum	12347
Maximum	18287
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	21.8 KiB

Quantile statistics

Minimum	12347
5-th percentile	12626.65
Q1	13815.25
median	15242.5
Q3	16779.75
95-th percentile	17950.35
Maximum	18287
Range	5940
Interquartile range (IQR)	2964.5

Descriptive statistics

Standard deviation	1714.984904
Coefficient of variation (CV)	0.1121953811
Kurtosis	-1.206915065
Mean	15285.69971
Median Absolute Deviation (MAD)	1483.5
Skewness	0.01599078757
Sum	42402531
Variance	2941173.222
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
17850	1	< 0.1%
14482	1	< 0.1%
17058	1	< 0.1%
17704	1	< 0.1%
16933	1	< 0.1%
13772	1	< 0.1%
16249	1	< 0.1%
14198	1	< 0.1%
13989	1	< 0.1%
17930	1	< 0.1%
Other values (2764)	2764	99.6%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
12347	1	< 0.1%
12348	1	< 0.1%
12352	1	< 0.1%
12356	1	< 0.1%
12358	1	< 0.1%
12359	1	< 0.1%
12360	1	< 0.1%
12362	1	< 0.1%
12364	1	< 0.1%
12370	1	< 0.1%

Value	Count	Frequency (%)
18287	1	< 0.1%
18283	1	< 0.1%
18282	1	< 0.1%
18273	1	< 0.1%
18272	1	< 0.1%
18270	1	< 0.1%
18265	1	< 0.1%
18263	1	< 0.1%
18261	1	< 0.1%
18260	1	< 0.1%

gross_revenue
Real number (ℝ_≥0)

HIGH CORRELATION

Distinct	2760
Distinct (%)	99.5%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	2904.751532

Minimum	36.56
Maximum	279138.02
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	21.8 KiB

Quantile statistics

Minimum	36.56
5-th percentile	264.557
Q1	628.9125
median	1170.87
Q3	2424.715
95-th percentile	7579.4915
Maximum	279138.02
Range	279101.46
Interquartile range (IQR)	1795.8025

Descriptive statistics

Standard deviation	10927.21927
Coefficient of variation (CV)	3.761843017
Kurtosis	331.9508666
Mean	2904.751532
Median Absolute Deviation (MAD)	688.765
Skewness	16.26093044
Sum	8057780.75
Variance	119404120.9
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
1025.44	2	0.1%
745.06	2	0.1%
598.2	2	0.1%
1078.96	2	0.1%
731.9	2	0.1%
1353.74	2	0.1%
2053.02	2	0.1%
379.65	2	0.1%
1314.45	2	0.1%
331	2	0.1%
Other values (2750)	2754	99.3%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
36.56	1	< 0.1%
52	1	< 0.1%
52.2	1	< 0.1%
62.43	1	< 0.1%
68.84	1	< 0.1%
70.02	1	< 0.1%
77.4	1	< 0.1%
84.65	1	< 0.1%
90.3	1	< 0.1%
93.35	1	< 0.1%

Value	Count	Frequency (%)
279138.02	1	< 0.1%
259657.3	1	< 0.1%
194550.79	1	< 0.1%
168472.5	1	< 0.1%
140450.72	1	< 0.1%
124564.53	1	< 0.1%
117379.63	1	< 0.1%
91062.38	1	< 0.1%
72882.09	1	< 0.1%
66653.56	1	< 0.1%

recency_days
Real number (ℝ_≥0)

ZEROS

Distinct	252
Distinct (%)	9.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	56.62689257

Minimum	0
Maximum	372
Zeros	34
Zeros (%)	1.2%
Negative	0
Negative (%)	0.0%
Memory size	21.8 KiB

Quantile statistics

Minimum	0
5-th percentile	2
Q1	10
median	29
Q3	73
95-th percentile	211
Maximum	372
Range	372
Interquartile range (IQR)	63

Descriptive statistics

Standard deviation	68.41964137
Coefficient of variation (CV)	1.208253504
Kurtosis	3.432018391
Mean	56.62689257
Median Absolute Deviation (MAD)	23.5
Skewness	1.898344739
Sum	157083
Variance	4681.247326
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
1	99	3.6%
4	87	3.1%
2	85	3.1%
3	85	3.1%
8	76	2.7%
10	67	2.4%
9	66	2.4%
7	65	2.3%
17	62	2.2%
22	55	2.0%
Other values (242)	2027	73.1%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
0	34	1.2%
1	99	3.6%
2	85	3.1%
3	85	3.1%
4	87	3.1%
5	43	1.6%
7	65	2.3%
8	76	2.7%
9	66	2.4%
10	67	2.4%

Value	Count	Frequency (%)
372	1	< 0.1%
366	1	< 0.1%
360	1	< 0.1%
358	3	0.1%
354	1	< 0.1%
337	1	< 0.1%
336	2	0.1%
334	1	< 0.1%
333	2	0.1%
330	1	< 0.1%

invoice_no
Real number (ℝ_≥0)

HIGH CORRELATION

Distinct	55
Distinct (%)	2.0%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	6.053352559

Minimum	2
Maximum	206
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	21.8 KiB

Quantile statistics

Minimum	2
5-th percentile	2
Q1	2
median	4
Q3	6
95-th percentile	17
Maximum	206
Range	204
Interquartile range (IQR)	4

Descriptive statistics

Standard deviation	9.071461768
Coefficient of variation (CV)	1.498584739
Kurtosis	183.9551027
Mean	6.053352559
Median Absolute Deviation (MAD)	2
Skewness	10.62505905
Sum	16792
Variance	82.29141862
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
2	780	28.1%
3	499	18.0%
4	393	14.2%
5	237	8.5%
6	173	6.2%
7	138	5.0%
8	98	3.5%
9	69	2.5%
10	55	2.0%
11	54	1.9%
Other values (45)	278	10.0%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
2	780	28.1%
3	499	18.0%
4	393	14.2%
5	237	8.5%
6	173	6.2%
7	138	5.0%
8	98	3.5%
9	69	2.5%
10	55	2.0%
11	54	1.9%

Value	Count	Frequency (%)
206	1	< 0.1%
199	1	< 0.1%
124	1	< 0.1%
97	1	< 0.1%
91	2	0.1%
86	1	< 0.1%
72	1	< 0.1%
62	2	0.1%
60	1	< 0.1%
57	1	< 0.1%

avg_quantity
Real number (ℝ_≥0)

HIGH CORRELATION
SKEWED

Distinct	2600
Distinct (%)	93.7%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	29.82792048

Minimum	1
Maximum	26999
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	21.8 KiB

Quantile statistics

Minimum	1
5-th percentile	2.559587889
Q1	6.365349265
median	10.33333333
Q3	15.0396017
95-th percentile	48.12125542
Maximum	26999
Range	26998
Interquartile range (IQR)	8.674252438

Descriptive statistics

Standard deviation	517.9117006
Coefficient of variation (CV)	17.36331908
Kurtosis	2654.457672
Mean	29.82792048
Median Absolute Deviation (MAD)	4.267741935
Skewness	51.01197811
Sum	82742.6514
Variance	268232.5296
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
10	8	0.3%
9.333333333	7	0.3%
11	6	0.2%
18	4	0.1%
6.5	4	0.1%
10.4	4	0.1%
9	4	0.1%
12	4	0.1%
12.5	4	0.1%
8	3	0.1%
Other values (2590)	2726	98.3%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
1	1	< 0.1%
1.052631579	1	< 0.1%
1.055555556	1	< 0.1%
1.131578947	1	< 0.1%
1.21875	1	< 0.1%
1.257142857	1	< 0.1%
1.260416667	1	< 0.1%
1.28	1	< 0.1%
1.376146789	1	< 0.1%
1.39408867	1	< 0.1%

Value	Count	Frequency (%)
26999	1	< 0.1%
2000	1	< 0.1%
1802.8	1	< 0.1%
1756.5	1	< 0.1%
1009.5	1	< 0.1%
740	1	< 0.1%
715.2	1	< 0.1%
664.6153846	1	< 0.1%
657	1	< 0.1%
600	1	< 0.1%

total_quantity
Real number (ℝ_≥0)

HIGH CORRELATION

Distinct	1639
Distinct (%)	59.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	1700.379957

Minimum	2
Maximum	196844
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	21.8 KiB

Quantile statistics

Minimum	2
5-th percentile	119.65
Q1	330.25
median	705.5
Q3	1478.75
95-th percentile	4645.5
Maximum	196844
Range	196842
Interquartile range (IQR)	1148.5

Descriptive statistics

Standard deviation	6079.161482
Coefficient of variation (CV)	3.575178276
Kurtosis	437.6447231
Mean	1700.379957
Median Absolute Deviation (MAD)	453.5
Skewness	17.32001834
Sum	4716854
Variance	36956204.33
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
310	11	0.4%
246	8	0.3%
150	8	0.3%
219	7	0.3%
200	7	0.3%
300	7	0.3%
493	7	0.3%
1200	7	0.3%
272	7	0.3%
260	7	0.3%
Other values (1629)	2698	97.3%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
2	1	< 0.1%
16	1	< 0.1%
17	1	< 0.1%
19	1	< 0.1%
20	1	< 0.1%
25	1	< 0.1%
27	2	0.1%
30	1	< 0.1%
32	1	< 0.1%
33	2	0.1%

Value	Count	Frequency (%)
196844	1	< 0.1%
80997	1	< 0.1%
80263	1	< 0.1%
77373	1	< 0.1%
69993	1	< 0.1%
64549	1	< 0.1%
64124	1	< 0.1%
63312	1	< 0.1%
58343	1	< 0.1%
57885	1	< 0.1%

avg_ticket
Real number (ℝ_≥0)

HIGH CORRELATION
SKEWED

Distinct	2772
Distinct (%)	99.9%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	52.33677308

Minimum	2.150588235
Maximum	56157.5
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	21.8 KiB

Quantile statistics

Minimum	2.150588235
5-th percentile	4.852702153
Q1	12.42379049
median	17.94212763
Q3	25.07465812
95-th percentile	88.42744262
Maximum	56157.5
Range	56155.34941
Interquartile range (IQR)	12.65086763

Descriptive statistics

Standard deviation	1071.049203
Coefficient of variation (CV)	20.46456325
Kurtosis	2718.321218
Mean	52.33677308
Median Absolute Deviation (MAD)	6.338589039
Skewness	51.90076423
Sum	145182.2085
Variance	1147146.395
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
14.47833333	2	0.1%
4.162	2	0.1%
6.269700855	1	< 0.1%
32.59775	1	< 0.1%
19.03048387	1	< 0.1%
28.55451613	1	< 0.1%
12.80068182	1	< 0.1%
6.396214689	1	< 0.1%
26.08797101	1	< 0.1%
17.98461538	1	< 0.1%
Other values (2762)	2762	99.6%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
2.150588235	1	< 0.1%
2.4325	1	< 0.1%
2.462371134	1	< 0.1%
2.511241379	1	< 0.1%
2.515333333	1	< 0.1%
2.65	1	< 0.1%
2.656931818	1	< 0.1%
2.707598253	1	< 0.1%
2.760621572	1	< 0.1%
2.770464191	1	< 0.1%

Value	Count	Frequency (%)
56157.5	1	< 0.1%
4453.43	1	< 0.1%
1687.2	1	< 0.1%
952.9875	1	< 0.1%
872.13	1	< 0.1%
841.0214493	1	< 0.1%
651.1683333	1	< 0.1%
640	1	< 0.1%
624.4	1	< 0.1%
615.75	1	< 0.1%

avg_recency_days
Unsupported

REJECTED
UNSUPPORTED

Missing	0
Missing (%)	0.0%
Memory size	21.8 KiB

frequency
Real number (ℝ_≥0)

SKEWED

Distinct	1225
Distinct (%)	44.2%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	0.04969870057

Minimum	0.005449591281
Maximum	17
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	21.8 KiB

Quantile statistics

Minimum	0.005449591281
5-th percentile	0.008746355685
Q1	0.01575839204
median	0.0243902439
Q3	0.04166666667
95-th percentile	0.1153846154
Maximum	17
Range	16.99455041
Interquartile range (IQR)	0.02590827462

Descriptive statistics

Standard deviation	0.337595074
Coefficient of variation (CV)	6.792835026
Kurtosis	2296.516337
Mean	0.04969870057
Median Absolute Deviation (MAD)	0.01069454458
Skewness	46.08539806
Sum	137.8641954
Variance	0.113970434
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0.0625	18	0.6%
0.02777777778	17	0.6%
0.02380952381	16	0.6%
0.08333333333	15	0.5%
0.09090909091	15	0.5%
0.02941176471	14	0.5%
0.03448275862	14	0.5%
0.01923076923	13	0.5%
0.02564102564	13	0.5%
0.02127659574	13	0.5%
Other values (1215)	2626	94.7%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
0.005449591281	1	< 0.1%
0.005464480874	1	< 0.1%
0.005479452055	1	< 0.1%
0.005494505495	1	< 0.1%
0.005586592179	2	0.1%
0.005602240896	1	< 0.1%
0.005617977528	2	0.1%
0.00566572238	1	< 0.1%
0.005681818182	2	0.1%
0.005698005698	3	0.1%

Value	Count	Frequency (%)
17	1	< 0.1%
3	1	< 0.1%
2	1	< 0.1%
1.142857143	1	< 0.1%
1	8	0.3%
0.75	1	< 0.1%
0.6666666667	3	0.1%
0.550802139	1	< 0.1%
0.5335120643	1	< 0.1%
0.5	3	0.1%

qty_returns
Real number (ℝ_≥0)

HIGH CORRELATION
SKEWED
ZEROS

Distinct	205
Distinct (%)	7.4%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	64.15897621

Minimum	0
Maximum	80995
Zeros	1481
Zeros (%)	53.4%
Negative	0
Negative (%)	0.0%
Memory size	21.8 KiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	0
median	0
Q3	9
95-th percentile	98
Maximum	80995
Range	80995
Interquartile range (IQR)	9

Descriptive statistics

Standard deviation	1564.393524
Coefficient of variation (CV)	24.38308116
Kurtosis	2586.254065
Mean	64.15897621
Median Absolute Deviation (MAD)	0
Skewness	50.10197766
Sum	177977
Variance	2447327.097
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0	1481	53.4%
1	129	4.7%
2	117	4.2%
3	82	3.0%
4	72	2.6%
6	63	2.3%
5	55	2.0%
12	45	1.6%
8	39	1.4%
9	38	1.4%
Other values (195)	653	23.5%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
0	1481	53.4%
1	129	4.7%
2	117	4.2%
3	82	3.0%
4	72	2.6%
5	55	2.0%
6	63	2.3%
7	38	1.4%
8	39	1.4%
9	38	1.4%

Value	Count	Frequency (%)
80995	1	< 0.1%
9014	1	< 0.1%
8004	1	< 0.1%
4427	1	< 0.1%
3768	1	< 0.1%
3332	1	< 0.1%
2878	1	< 0.1%
2022	1	< 0.1%
2012	1	< 0.1%
1776	1	< 0.1%

avg_basket_size
Real number (ℝ_≥0)

HIGH CORRELATION
SKEWED

Distinct	1938
Distinct (%)	69.9%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	245.961992

Minimum	1
Maximum	40498.5
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	21.8 KiB

Quantile statistics

Minimum	1
5-th percentile	45
Q1	103.3333333
median	172.125
Q3	278.2375
95-th percentile	587.875
Maximum	40498.5
Range	40497.5
Interquartile range (IQR)	174.9041667

Descriptive statistics

Standard deviation	808.0807949
Coefficient of variation (CV)	3.285388887
Kurtosis	2223.352169
Mean	245.961992
Median Absolute Deviation (MAD)	81.29166667
Skewness	44.86093386
Sum	682298.5657
Variance	652994.5711
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
100	11	0.4%
86	9	0.3%
75	8	0.3%
60	8	0.3%
208	7	0.3%
105	7	0.3%
82	7	0.3%
73	7	0.3%
136	7	0.3%
197	7	0.3%
Other values (1928)	2696	97.2%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
1	1	< 0.1%
3.333333333	1	< 0.1%
5.333333333	1	< 0.1%
5.666666667	1	< 0.1%
6.142857143	1	< 0.1%
7.5	1	< 0.1%
9	1	< 0.1%
9.5	1	< 0.1%
11	1	< 0.1%
11.875	1	< 0.1%

Value	Count	Frequency (%)
40498.5	1	< 0.1%
6009.333333	1	< 0.1%
3868.65	1	< 0.1%
2880	1	< 0.1%
2733.944444	1	< 0.1%
2518.769231	1	< 0.1%
2160.333333	1	< 0.1%
2082.225806	1	< 0.1%
2000	1	< 0.1%
1903.5	1	< 0.1%

avg_un_basket_size
Real number (ℝ_≥0)

HIGH CORRELATION

Distinct	897
Distinct (%)	32.3%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	17.13545486

Minimum	0.2
Maximum	177
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	21.8 KiB

Quantile statistics

Minimum	0.2
5-th percentile	2
Q1	7.511363636
median	13.5
Q3	22
95-th percentile	45.0875
Maximum	177
Range	176.8
Interquartile range (IQR)	14.48863636

Descriptive statistics

Standard deviation	14.26329428
Coefficient of variation (CV)	0.8323849233
Kurtosis	10.00578646
Mean	17.13545486
Median Absolute Deviation (MAD)	6.666666667
Skewness	2.246049339
Sum	47533.75179
Variance	203.4415637
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
8	34	1.2%
13	33	1.2%
9	32	1.2%
16	32	1.2%
7	32	1.2%
12	30	1.1%
14	29	1.0%
6	29	1.0%
17	29	1.0%
18.5	29	1.0%
Other values (887)	2465	88.9%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
0.2	1	< 0.1%
0.25	3	0.1%
0.3333333333	6	0.2%
0.4	1	< 0.1%
0.4090909091	1	< 0.1%
0.5	12	0.4%
0.5454545455	1	< 0.1%
0.5555555556	1	< 0.1%
0.5714285714	1	< 0.1%
0.6176470588	1	< 0.1%

Value	Count	Frequency (%)
177	1	< 0.1%
105	1	< 0.1%
104	1	< 0.1%
98	1	< 0.1%
95.5	1	< 0.1%
94.33333333	1	< 0.1%
93.33333333	1	< 0.1%
89.625	1	< 0.1%
87	1	< 0.1%
85.66666667	1	< 0.1%

stock_code
Real number (ℝ_≥0)

HIGH CORRELATION

Distinct	467
Distinct (%)	16.8%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	129.7433309

Minimum	2
Maximum	7838
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	21.8 KiB

Quantile statistics

Minimum	2
5-th percentile	10
Q1	34
median	72
Q3	143
95-th percentile	400.05
Maximum	7838
Range	7836
Interquartile range (IQR)	109

Descriptive statistics

Standard deviation	277.7854086
Coefficient of variation (CV)	2.141038053
Kurtosis	336.8230491
Mean	129.7433309
Median Absolute Deviation (MAD)	45
Skewness	15.34866005
Sum	359908
Variance	77164.73323
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
28	38	1.4%
35	34	1.2%
27	30	1.1%
26	30	1.1%
29	30	1.1%
15	27	1.0%
19	27	1.0%
25	27	1.0%
31	27	1.0%
33	26	0.9%
Other values (457)	2478	89.3%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
2	11	0.4%
3	13	0.5%
4	16	0.6%
5	16	0.6%
6	24	0.9%
7	14	0.5%
8	13	0.5%
9	19	0.7%
10	19	0.7%
11	23	0.8%

Value	Count	Frequency (%)
7838	1	< 0.1%
5673	1	< 0.1%
5095	1	< 0.1%
4580	1	< 0.1%
2698	1	< 0.1%
2379	1	< 0.1%
2060	1	< 0.1%
1818	1	< 0.1%
1673	1	< 0.1%
1637	1	< 0.1%

Spearman's ρ

The Spearman's rank correlation coefficient (ρ) is a measure of monotonic correlation between two variables, and is therefore better in catching nonlinear monotonic correlations than Pearson's r. It's value lies between -1 and +1, -1 indicating total negative monotonic correlation, 0 indicating no monotonic correlation and 1 indicating total positive monotonic correlation.

To calculate ρ for two variables X and Y, one divides the covariance of the rank variables of X and Y by the product of their standard deviations.

Pearson's r

The Pearson's correlation coefficient (r) is a measure of linear correlation between two variables. It's value lies between -1 and +1, -1 indicating total negative linear correlation, 0 indicating no linear correlation and 1 indicating total positive linear correlation. Furthermore, r is invariant under separate changes in location and scale of the two variables, implying that for a linear function the angle to the x-axis does not affect r.

To calculate r for two variables X and Y, one divides the covariance of X and Y by the product of their standard deviations.

Kendall's τ

Similarly to Spearman's rank correlation coefficient, the Kendall rank correlation coefficient (τ) measures ordinal association between two variables. It's value lies between -1 and +1, -1 indicating total negative correlation, 0 indicating no correlation and 1 indicating total positive correlation.

To calculate τ for two variables X and Y, one determines the number of concordant and discordant pairs of observations. τ is given by the number of concordant pairs minus the discordant pairs divided by the total number of pairs.

Phik (φk)

Phik (φk) is a new and practical correlation coefficient that works consistently between categorical, ordinal and interval variables, captures non-linear dependency and reverts to the Pearson correlation coefficient in case of a bivariate normal input distribution. There is extensive documentation available here.

Count
Matrix

A simple visualization of nullity by column.

Nullity matrix is a data-dense display which lets you quickly visually pick out patterns in data completion.

First rows

	df_index	customer_id	gross_revenue	recency_days	invoice_no	avg_quantity	total_quantity	avg_ticket	avg_recency_days	frequency	qty_returns	avg_basket_size	avg_un_basket_size	stock_code
0	0	17850	5391.21	372.0	34.0	5.835017	1733.0	18.152222	1 days 00:00:00	17.000000	40.0	50.970588	0.617647	297.0
1	1	13047	3232.59	56.0	9.0	8.128655	1390.0	18.904035	52 days 20:00:00	0.028302	35.0	154.444444	11.666667	171.0
2	2	12583	6705.38	2.0	15.0	21.672414	5028.0	28.902500	26 days 12:00:00	0.040323	50.0	335.200000	7.600000	232.0
3	3	13748	948.25	95.0	5.0	15.678571	439.0	33.866071	92 days 16:00:00	0.017921	0.0	87.800000	4.800000	28.0
4	4	15100	876.00	333.0	3.0	26.666667	80.0	292.000000	20 days 00:00:00	0.073171	22.0	26.666667	0.333333	3.0
5	5	15291	4623.30	25.0	14.0	20.607843	2102.0	45.326471	26 days 18:27:41.538461538	0.040115	29.0	150.142857	4.357143	102.0
6	6	14688	5630.87	7.0	21.0	11.073394	3621.0	17.219786	19 days 06:18:56.842105263	0.057221	399.0	172.428571	7.047619	327.0
7	7	17809	5411.91	16.0	12.0	33.721311	2057.0	88.719836	39 days 16:00:00	0.033520	41.0	171.416667	3.833333	61.0
8	8	15311	60767.90	0.0	91.0	16.054645	38194.0	25.543464	4 days 04:35:03.370786516	0.243316	474.0	419.714286	6.230769	2379.0
9	9	16098	2005.63	87.0	7.0	9.149254	613.0	29.934776	47 days 16:00:00	0.024390	0.0	87.571429	4.857143	67.0

Last rows

	df_index	customer_id	gross_revenue	recency_days	invoice_no	avg_quantity	total_quantity	avg_ticket	avg_recency_days	frequency	qty_returns	avg_basket_size	avg_un_basket_size	stock_code
2764	5611	17290	525.24	3.0	2.0	3.960784	404.0	5.149412	13 days 00:00:00	0.142857	0.0	202.000000	46.000000	102.0
2765	5620	14785	77.40	10.0	2.0	28.000000	84.0	25.800000	5 days 00:00:00	0.333333	0.0	42.000000	1.000000	3.0
2766	5621	17254	272.44	4.0	2.0	2.250000	252.0	2.432500	11 days 00:00:00	0.166667	0.0	126.000000	50.000000	112.0
2767	5637	17232	421.52	2.0	2.0	5.638889	203.0	11.708889	12 days 00:00:00	0.153846	0.0	101.500000	15.000000	36.0
2768	5638	17468	137.00	10.0	2.0	23.200000	116.0	27.400000	4 days 00:00:00	0.400000	0.0	58.000000	2.500000	5.0
2769	5649	13596	697.04	5.0	2.0	2.445783	406.0	4.199036	7 days 00:00:00	0.250000	0.0	203.000000	66.500000	166.0
2770	5655	14893	1237.85	9.0	2.0	10.945205	799.0	16.956849	2 days 00:00:00	0.666667	0.0	399.500000	36.000000	73.0
2771	5680	14126	706.13	7.0	3.0	33.866667	508.0	47.075333	3 days 00:00:00	0.750000	50.0	169.333333	4.666667	15.0
2772	5686	13521	1092.39	1.0	3.0	1.685057	733.0	2.511241	4 days 12:00:00	0.300000	0.0	244.333333	104.000000	435.0
2773	5696	15060	301.84	8.0	4.0	2.183333	262.0	2.515333	1 days 00:00:00	2.000000	0.0	65.500000	20.000000	120.0

Overview

Variables

Interactions

Correlations

Spearman's ρ

Pearson's r

Kendall's τ

Phik (φk)

Missing values

Sample

First rows

Last rows